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Abstract. This paper presents coordination algorithms for groups of mobile agents performing de- 
ployment and coverage tasks. As an important modeling constraint, we assume that each mobile 
• agent has a limited sensing/communication radius. Based on the geometry of Voronoi partitions and 

proximity graphs, we analyze a class of aggregate objective functions and propose coverage algorithms 
in continuous and discrete time. These algorithms have convergence guarantees and are spatially 
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' distributed with respect to appropriate proximity graphs. Numerical simulations illustrate the results. 
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Introduction 

O " 

' The current technological development of relatively inexpensive communication, computation, and 
sensing devices has lead to an intense research activity devoted to the distributed control and coordi- 
I nation of networked systems. In robotic settings, the study of large groups of autonomous vehicles is 
' nowadays a timely concern. The potential advantages of networked robotic systems are their versatility 
and robustness in the realization of multiple tasks such as manipulation in hazardous environments, 
pollution detection, estimation and map-building of partially known or unknown environments. 

A fundamental problem in the distributed coordination of mobile robots is that of providing stable 
and decentralized control laws that are scalable with the number of agents in the network. Indeed, 
■ since the initial works from the robotics and ecology communities on similar problems on swarms 
and flocking [1-3], there have been various efforts to provide rigorous procedures with convergence 
guarantees using a combination of potential energy shaping methods, gyroscopic forces, and graph 
theory [4-8]. In our previous work [9,10], we studied distributed algorithms for deployment and opti- 
mal coverage problems using tools from computational geometry, nonsmooth analysis and geometric 
optimization. The great interest in coordination problems can be easily detected in the proceedings 
of the most recent IEEE Conference on Decision and Control, the Conference on Cooperative Control 
and Optimization, or the International Conference on Distributed Autonomous Robotic Systems. 
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2 DISTRIBUTED COVERAGE OPTIMIZATION AND CONTROL WITH RANGE-LIMITED INTERACTIONS 

In devising useful coordination algorithms it is important to progressively account for the various 
restrictions that real- world systems impose. Building on our previous work [9,10], this paper develops 
spatially-distributed algorithms for coverage control amenable to implementation on (more) realistic 
models of networks; we do this by considering the following new aspects. Firstly, we enforce the 
communication or sensing capacity of an agent to be restricted to a bounded region, typically much 
smaller than the region where the entire network is confined. In other words, we assume that the 
agents will have limited-range communication and/or sensing capabilities: we refer to these informa- 
tion exchanges between agents as "limited-range interactions." Secondly, we provide gradient ascent 
control laws in both continuous and discrete-time settings, and we prove that the induced dynam- 
ical systems are convergent. Discrete-time feedback algorithms are indeed the ones truly amenable 
to implementation in a group of agents exchanging information over a communication network. To 
deal with these problems, we use a seemingly unrelated combination of tools from graph theory [11], 
locational optimization [12,13], and systems theory [14]. 

The contributions of the paper are the following: 

(i) Based on the notion of proximity graph [15] , we provide a formal notion of spatially-distributed 
vector fields and functions; we introduce a novel proximity graph, called limited-range Delau- 
nay graph, related to the notion of Delaunay graph and disk graph; we study the properties 
of the limited-range Delaunay graph and we show, in a formal way, that it can be computed 
in a spatially-distributed fashion. 

(ii) We analyze the smoothness properties of an important class of objective functions, called 
multi-center functions, common in locational optimization, quantization theory, and geometric 
optimization. Our analysis supersedes the results in [12,13,16-19]. One important objective 
of the analysis is to determine the extent in which certain multi-center functions are spatially 
distributed and with respect to which proximity graphs. 

(iii) We consider the problem of steering the location of a group of robots to local maxima of the 
objective function. To achieve this objective in continuous and discrete-time, we design novel 
spatially-distributed control laws for groups of robots. We formally analyze their performance 
and illustrate their behavior in simulations. 

To perform the smoothness analysis in (ii) and the stability analysis in (iii), we prove useful exten- 
sions of the Conservation-of-Mass Law from fluid dynamics and of the discrete-time LaSalle Invariance 
Principle, respectively. These extensions are, to the best of our knowledge, not present in classical 
texts on the subject. 

It is worth remarking that one fundamental scientific problem in the study of coordination algo- 
rithms is scalability with respect to communication complexity. In other words, it is important to 
design algorithms with communication requirements that scale nicely (e.g., linearly) with the number 
of agents in the network. However, it is impossible to quantify the communication complexity of any 
algorithm without introducing a detailed communication model. Adopting a computational geometric 
approach, this paper classifies the complexity of coordination algorithms in terms of the proximity 
graphs with respect to which the algorithms are spatially distributed. The underlying assumption is 
that low complexity proximity graphs (e.g., graphs with a low number of edges) will require limited 
communication in a realistic implementation. 

Throughout the paper we shall consider purposefully only extremely simple models for the dynamics 
of each individual agent. In particular, we shall assume that the state of each agent is a point in M? 
and that the dynamical model of each agent is an integrator (indeed, we shall interchangeably refer 
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to agent as a location or point). This feature is a natural consequence of our focus on network- wide 
coordination aspects. 

The organization of the paper is as follows. In Section ^ we review various preliminary mathemat- 
ical concepts, and we introduce the notion of proximity graph function and of spatially-distributed 
map. In Section [2 we study the smoothness of the multi-center function and show in what sense its 
partial derivative is spatially distributed. In Section |31 we design spatially-distributed coverage algo- 
rithms, first in continuous-time and then in discrete-time. The numerical outcomes of the algorithms' 
implementation are reported in Section ^ Finally, we discuss possible avenues of future research in 
Section El 

1. Preliminaries 

In this section we present a variety of preliminary concepts. Graph theory and proximity graphs 
from computational geometry are basic notions that will later allow us to introduce the notion of 
spatially-distributed vector fields and algorithms. 

1.1. Basic notions in graph theory 

Here we gather some basic facts on graph theory; for a comprehensive treatment we refer the reader 
to [11]. Given a set lA, recall that 2^ is the collection of subsets oiU. A graph Q = {U,£) consists of 
a vertex set U and an edge set £ C 2^^^. A graph {U,£) is undirected if (i,j) G £ implies (j, i) e £. 
If G £, then vertex j is a neighbor (in Q) of vertex i. Let J\fg : ^ 2^ associate to the vertex 
i the set of its neighbors in ^. A graph Q is called complete if any two different vertexes in U are 
neighbors, i.e., £ = U x V( \ diag(^ x U). This is usually denoted by X". A path connecting vertex i 
to vertex j is a sequence of vertexes {iq = i,ii, . . . , ik,ik+i = j} with the property that (i/, G £ 
for all I £ {0,... ,k}. A graph Q is connected if there exists a path connecting any two vertexes 
of Q. Given two graphs Qi = {Ui,£\) and Q2 = {1^2, £2), the intersection graph Qir\Q2 is the graph 
(Z^i nZY2,£'i n£'2), and the union graph Q1UQ2 is the graph (ZYi UZY2, ^1 U £"2). 

A graph Qi = {Ui,£i) is a subgraph of a graph G2 = (^2,^2) if ^1 ^ U2 and £1 C £2. Alternatively, 
Q2 is said to be a supergraph of Gi. Formally, we set Qi C Q2. If Qi C Q2 and Qi contains all the 
edges G £2 with i,j £ Ui, then Qi is called an induced subgraph 0/^2- A subgraph Qi of Q2 is 
called spanning \iUi =U2- A cycle of ^ is a subgraph where every vertex has exactly two neighbors. 
An acyclic graph is a graph that contains no cycles. A tree is a connected acyclic graph. Given a 
connected graph G, assign to each edge an specific length or weight. The weight of a subgraph of G 
is the sum of the weights of its edges. A minimum spanning tree of G is a spanning tree with the 
smallest possible weight. In general, there might exist more than one minimum spanning tree of G, 
all with the same weight. 

1.2. Voronoi partitions and proximity graphs 

We start by reviewing the notion of Voronoi partition generated by sets of points on the Euclidean 
plane; we refer the reader to [12,20] for comprehensive treatments. Next, we shall present some relevant 
concepts on proximity graph functions, that is, on graphs whose vertex set is (in 1-1 correspondence 
with) a set of distinct points on the plane and whose edge set is a function of the relative locations 
of the point set. This notion is an extension of the notion of proximity graph as explained in the 
survey article [15]; see also [21] and the literature on topology control in wireless networks for related 
references. 
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A covering of M? is a collection of subsets of M? whose union is M^; a partition of M? is a covering 
whose subsets have disjoint interiors. Let V he a set of n distinct points {pi, . . . ,pn} in M?. The 
Voronoi partition of generated by V with respect to the Euclidean norm is the collection of sets 
{^i(^)}ie{i,...,n} defined by 

V^{V) = {gG]R2 I \\q_p.\\ < \\q-pj\\^ for ahp^ Gp}. 

Here, || • || denotes the standard Euclidean norm. It is customary and convenient to refer to Vi(V) as 
Vi. The boundary of each set Vi is the union of a finite number of segments and rays. 

Let Tin be the set of permutations of n elements. A map / : X" 2^^^ is Tn-equivariant if for 
all (xi, . . . G X" and 0- G {xi,Xj) G f{xi,.. .,Xn) implies x^q)) G /(x<^(i),. . . ,x<^(„)). 

A proximity graph function associates to a set of n distinct points V = {pi, . . . ,Pn} in a graph 
with vertex set V and edge set £{pi, . . . ,Pn): where £ : (R^)" _> is a S„-equivariant map with 

the property that £{pi, . . . ,pn) CV"^ = {pi, . . . ,p„}2 = {pi, . . . x {pi, . . . 

Note that, since the map £ is S„-equivariant, the value of £{pi,...,pn) is independent of the 
ordering of the elements (pi, . . . ,pn), and therefore, with a slight abuse of notation, we will write 
it as {pi, . . . ,Pn} = V ^ £i'P)i ^-iid refer to it as the proximity edge function corresponding to the 
proximity graph function V ^ QiV)- 

For p G and r G M+ = [0, +00), let Br{p) = [qe'M? \ \\q - p\\ < r] denote the closed ball in 
centered at p of radius r. Now, for r G M+, we have the following proximity graph functions: 

(i) the Delaunay graph V ^ Gd{'P) = {'Pt£d{'P)) has edge set 

£d{V) = {{p^,PJ) G p2 \diag(p2) I Vi{V)nVj{V) / 0} ; 

(ii) the r-disk graph V ^diskl'P,'^) = ^ ■,£diskij^ if)) has edge set 

^disk(7^,r) = {{pi,Pj) G p2 \diag(p2) I \\p,-p^\\ < r] ; 

(iii) the r-Delaunay graph V ^ Qd\skr\Ti(J^ if) is the intersection of Gdisk(J^-,f) and Qti{V); 

(iv) the r-limited Delaunay (or, limited-range Delaunay) graph V 1— > GhDi'Pir) = i'P,£LD{'P,''')) 
consists of the edges {pi,Pj) G \ diag('P^) with the property that 

A.,(P, r) ^ {v,{v) n Brip,)) n {v,{v) n Br{pj)) / ; (i) 

(v) the Gabriel graph, V ^ Gci'P) = ^■,£g{'P)) consists of the edges {pi,Pj) G \ diag('P^) 
with the property that 

Pk int (^4^) ' all A: G {1, . . . , n} \ {i,j} ; (2) 

(vi) an Euclidean Minimum Spanning Tree, V i— > ^emst('P) = ("P, '?emst('P)) is defined as a 
minimum spanning tree of the complete graph ('P,'P^ \ diag('P^), whose edge {pi,Pj) has 
weight \\pi -pjW, for {i,j) G {1, . . . ,n}. 

Figure ^ presents an example of these proximity graphs for a random configuration of points. In 
general, one can prove that ^emst('P) ^ Gci'P) ^ ^d('P) (see for instance [15]). While the r- 
Delaunay graph has been studied in earlier works [21,22], the r-limited Delaunay graph appears not 
to have been considered. In the next proposition, we study some basic useful properties of these 
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graphs. Before presenting it, let us recall the following notation from computational geometry. We 
denote the cardinality of a set S by i^S. Given / : N — > N and a function F that associates to a 
set of n distinct points V = {pi, . . . ,Pn} in a non-negative integer number F{{pi, . . . ,Pn}) G N, 
we denote F = 0{f{n)) (respectively, F = Q{f{n))) if and only if there exists C £ M+ such that 
F{{pi, . . . ,pn}) < C f{n) (respectively, F{{pi, . . . > C f{n)) for ah distinct pi, . . . ,Pn G M^. We 

denote F = G(/(n)) if and only if both F = 0{f{n)) and F = ^{f{n)) hold true. 



Delaunay graph 




r-disk graph 




r-Delaunay graph 




r-limited Delaunay graph 



Gabriel graph 



EMST graph 





i. 



Figure 1. From left to right, and from up to down, Delaunay, r-disk, r-Delaunay, 
r-limited Delaunay, Gabriel and Euclidean Minimum Spanning Tree graphs for a con- 
figuration of 16 generators with coordinates contained in the rectangle [0, 1.9] x [0, .75]. 
The parameter r is taken equal to .45. 



Proposition 1.1. Let V he a set of n distinct points {pi, . . . ,Pn} in E?, and let r G M+. The following 
statements hold 

(i) ^disknG(^,'^) ^ ^ld('P,0 ^ ^disknD(^,'^); 

(ii) Gdiski'P,''') is connected if and only if Qld{'P,''') is connected; 

(in) #£'ld(P) = 0{n) and #£diski'P,r) = 0{n^). If Gdisk{'P,r) is connected, then ^SldCP) = 
e(n). 

Proof. We first prove the inclusion ^disknG(^) ^ ^ld(^,'")- Let {pi,Pj) G '?disknG(^) From the 
definition of the Gabriel graph, we deduce that || ^''^^^ — Pi\\ = ll^^^x^ ~ PjW — II ^'^2^^ ~Pfc||) for all 
k G {1, . . . ,n} \ {i,j}, and therefore, £ Vi n Vj. Since {pi,Pj) G Sdiski'P , i") , we deduce that 

^^^^ G B;_{pi) nBr(^pj)^ and hence equation ^ holds, i.e., {pi,Pj) G ShDCP^r). The second inclusion 
in (i) is straightforward: if {pi,Pj) G <f^LD('P5 J"), then equation ^ implies that ViiV) n Vj(V) / 0, 
i.e., ipi,Pj) G <£'d('P). Since clearly {pi,Pj) G £diskij^ -.f)-, we conclude (i). The statement (ii) is a 
consequence of the following more general fact: the r-disk graph QdiskiJ^ ^f) is connected if and only 
if ^emst('P) C Qdisk{T^,r). The proof of this fact is as follows. If ^emst(^) C ^disk(7',r), then 
clearly ^disk('P,'^) is connected. To prove the other implication, assume that ^disk('P,'^) is connected. 
We reason by contradiction. Let ^emst('P) 2 Qdiski'P if)-, he, there exists pi and pj with {pi,Pj) G 
^emst('P) and ||pj — Pj|| > r. If we remove this edge from <?emst('P)) the tree becomes disconnected 
into two connected components Ti and T2, with pi G Ti and pj G T2. Now, since by hypothesis the 
r-disk graph ^disk('P)'") is connected, there must exist k,l G {l,...,n} such that pk G Ti, pi G T2 
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and \\pk — pi\\ < r. If we add the edge {pk,Pi) to the set of edges of Ti U T2, the obtained graph 
Q is acycHc, connected and contains all the vertexes V, i.e., ^ is a spanning tree. Moreover, since 
\\Pk — Pi\\ < r < \\pi — pjW and Ti and T2 are induced subgraphs of ^emst('P)) we conclude that Q 
has smaller length than ^emstI'P, which is a contradiction. As a consequence, we deduce that 
if Qdiski'P,''') is connected, then ^emst('P) Q ^disknG('P> Using (i), we conclude that GhDi'Pjr) is 
connected. Finally, the statement (iii) follows from (i) and (ii) by noting that ^£d{'P) < 3n — 6 (see, 
for instance, [12]) and #<?emst('P) = n — 1. □ 

Let us make the following observations concerning ProDosition ll.il 

Remarks 1.2. As before, let V he a set of n distinct points {pi, . . . ,pn} in M^, and let r G M+. 

(i) The r-Delaunay graph does not coincide in general with the r-limited Delaunay graph. Fig- 
ure [2 illustrates a point set V in which pi is a neighbor of pi in ^disknD(^) but not in 
GLD{'P,r). 




Pi 



Figure 2. Example point set for which the r-Delaunay graph strictly contains the 
r-limited Delaunay graph: pi is a neighbor of in ^disknDl'P, J') but not in GhDi'P,''"). 

(ii) The collection {Vi(P)ni?L(pi)}jg|i ,,, „} is a partition of the set Uii?r(pi) C M^. The boundary 
of each set Vi{V) H B^{pi), i E {1, . . . ,n}, is the union of a finite number of segments and 
arcs; see Figure 01 Therefore, at fixed V, there exist n numbers Mi{r) > 0, i G {1, . . . ,n}, 
of distinct arcs arcj^i(r), . . . , arcj jv/i(r)(^) of radius | in d{Vi{V) n Bji{pi)) with the property 
that 

d{V,{V) n Br_{pi)) = (UjeMg^^^r.rM) Aii(o) U {u ,. . . ,M.{r)} arcij(O) , 

where we recall that '^g-^j^{'p,r){Pi) denotes the set of neighbors in Qhoi'P, f) of the vertex pi. 

(iii) If \\pi — PjW is strictly greater than r, then the half plane {g G | Hg — < H^ — 
contains the ball Bi_{pi). Accordingly, 

Br_{p,)^Vi{V)=Br^{pi)r\{qe^^ I Ik -Pill < Ik -Pill, for all eV} 

= Bi_{pi) n {g G I Ik -Pill < Ik -Pill , for aWpj G J^g,,i,^(v,r){Pi)] ■ 
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' -'Pi 



Figure 3. The shaded regions are examples of sets Vi{T') n Bl (pi). In the right figure, 
the boundary of the set ViiV) R Br[pi) does not contain any arc. 

(iv) It is customary and convenient to refer to the various proximity graphs functions without 
expUcitly writing the argument V. • 

Finahy, we conclude this section with a general note. 

Remark 1.3. In the previous definitions, we have emphasized the fact that the points {pi, . . . ,Pn} are 
distinct. Occasionally though, we will consider tuples of elements of E? of the form (pi, . . . ,Pn), i-e., 
ordered sets of possibly coincident points. In this case, it is useful to adopt the following notation: given 
a tuple (pi, . . . ,pn) G (M^)", possibly containing repeated entries, we let {pi, . . . ,Pn}, or equivalently 
V, denote the associated point set that only contains the corresponding distinct points. The cardinality 
of "P = {pi, . . . ,pn} is therefore less than or equal to n. More precisely, if S denotes the set 

S = {{pi, . . . ,pn) G (M^)" I Pi =Pj for some i,j E {1, . . . , n}, z / j} , (3) 

then #V < n if (pi, . . . G S and i^V = n if (pi, . . . ,p„) S. The Voronoi covering V(pi, . . . ,Pn) = 
{^(pij • • • iPn)}iG{i,...,n} generated by the tuple {pi, . . . ,pn) is defined by assigning to each point pi its 
corresponding Voronoi cell in the Voronoi partition generated by V. Note that coincident points in the 
tuple (pi, . . . ,Pn) have the same Voronoi cell. It is interesting to note that if the points pi, . . . ,p„ G 
are not necessarily distinct, then both jj^£-Q{V) = 0{n'^) and #<fLD('P) = 0{n'^). • 

1.3. Spatially-distributed functions, vector fields, and set- valued maps 

We are now in a position to discuss distributed control laws and algorithms in formal terms. From 
now on, we shall deal not only with sets of distinct points, but also with tuples of elements of M^. 
Let ^ be a proximity graph function and let y be a set. A map / : (M^)" — > y" is spatially distributed 
over Q if there exist maps /j : x 2^'^ — > y, i G {!,..., n}, with the property that for all 
(pi,...,p„) G (]R2)- 

/i(pi, . . . ,p„) = /i(pi, {pj G I Pj G A/'g({p^^...^p„})(pi)}) , 

where fi denotes the ith-component of /. A vector field X on (M^)" is spatially distributed over Q if its 
associated map X : (R^)" — > (R^)", where the canonical identification between the tangent space of 
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(R^)*^ and (M^)" itself is understood, is spatially distributed in the above sense. Finally, a set-valued 
map T : (M^)'" 2^-^^^ is spatially distributed over Q if there exist maps f - : x 2^'^')" 2^^ , 
i E {1, . . . , n}, with the property that for all (pi, . . . ,Pn) G (M^)"' 

Ti{pi, . . . ,p„) = fi{pi, {pj G I pj G J^g{{p^,...,p„}){Pi)]) , 
where Tj denotes the ith-component of T. 

Remark 1.4. In other words, to compute the ith component of a spatially-distributed function, 
vector field, or set-valued map at (pi, . . . ^Pn)^ it is only required the knowledge of the vertex pi and 
the neighboring vertexes in the graph Q{{pi, ■ ■ ■ ,Pn})- • 

We are now in a position to establish an important property of the r-limited Delaunay graph. 
Lemma 1.5. Let r G M+. The map Mg^^(.^r) ■ {^^T ^ [2('^')"]", defined by 

(pi, ...,pn)^ (M7LD({pi,...,Pn},r)(Pl), • • • .M?LD({pi,...,Pn},r)(Pn)) , 

is spatially distributed over ^disk({pi; • • • ,Pn},r). 

Proof. The result follows from Remarkll. ytiii)! □ 



Loosely speaking, this lemma states that the r-limited Delaunay graph can be computed in a 
spatially localized way: each agent needs to know only the location of all other agents in a disk of 
radius r. This property is to be contrasted with the centralized computation required to determine 
the r-Delaunay graph ^disknD • This requirement can be observed in Figure |2j if pj and pi are placed 
arbitrarily close to the line joining andpk, then, in order to decide iipi G A/'g^.^^^p(-p^,.)(pj), in general 
it is necessary to know the locations of all the other points in {pi, . . . ,Pn}- 

1.4. Piecewise smooth sets and a generalized Conservation-of-Mass Law 

A set 5 C is called strictly star-shaped if there exists a point p G 5 such that for all s G dS 
and all A G (0,1], one has that Xp + {1 — X)s G int(S'). A curve C in is the image of a map 
7 : [a, h\ ^ R^. The map 7 is called a parameterization of C. A curve 7 : [a, h] — > is simple if it is 
not self-intersecting, i.e., if 7 is injective on {a,b). A curve is closed if 7(a) = 7(6). A set C is 
said to be piecewise smooth if its boundary, dil., is a simple closed curve that admits a continuous and 
piecewise smooth parameterization 7 : ^ M^. Likewise, a collection of sets |r2 {x)cR^\x£ {a,b)} 
is said to be a piecewise smooth family if Q{x) is piecewise smooth for all x G (a, b), and there exists 
7 : X (0,6) — > M^, {6,x) I— > 7(0, x), differentiable with respect to its second argument such that for 
each X G (a, 6), the map 6 1— > 7x(0) = ^{0,x) is a continuous and piecewise smooth parameterization 
of dQ{x). We refer to 7 as a parameterization for the family C | 2; G (a, &)|. 

The following result is an extension of the integral form of the Conservation-of-Mass Law in fluid 
mechanics [23]. The proof is given in Appendix ^ Given a curve C parameterized by a piecewise 
smooth map 7 : [a, b] — > C, recall that the line integral of a function / : C C ^ M over C is defined 

by 

/= f f{i{t))m)\dt, 

C J a 



and it is independent of the selected parameterization. 
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Proposition 1.6. Let {Q{x) C Q\x (^)^)} be a piecewise smooth family such that Q{x) is strictly 
star-shaped for all x G ia,b). Let the function (p : Q x {a,b) ^ M be continuously differentiable with 
respect to its second argument for all x E (a, 6) and almost all q £ ^}{x), and such that for each 
X G {a,b), the maps q i— > (j)[q,x) and q i— > ^{q,x) are integrable on Q{x). Then, the function 

{a,b) 3 X ^ / (f){q,x)dq (4) 
Jn(x) 

is continuously differentiable and 

[ (t){q,x)dq= [ ^{q,x)dq+ [ n*|^ (/>(-, , 
Jn(x) Jn{x) ox Jq^(^^) dx 

where n : dQ{x) — > R^, q i— > n{q), denotes the unit outward normal to dQ{x) at q £ dQ,{x), and 
7 : S"*^ X {a,b) —>-'R.'^ is a parameterization for the family C | x € (a, &)}. 

Remark 1.7. Note that this result can be readily extended to any family of sets {Q{x) \ x £ (a, ^)} 
that admits a suitable decomposition into piecewise smooth families consisting of strictly star-shaped 
sets. For instance, if {^i{x) \ x £ (a, 6)}, i £ {1,2} are two piecewise smooth families with strictly 
star-shaped sets and we consider the family Q{x) = Qi{x) \ ^2{x), for all x £ {a,b), then the same 
result holds for the function 

X £ {a,b) 1-^ / (f){q,x)dq= / (f>{q,x)dq— / (f){q,x)dq, 
Jn{x) Jni{x) JQ.2{x) 

by applying Proposition 11.61 to each summand on the right-hand side of the equality. • 



2. LIMITED-RANGE LOCATIONAL OPTIMIZATION 

Let Q be a simple convex polygon in including its interior. The diameter of Q is defined 
as diam((5) = maxg^pgQ \\q — p\\. For 6,e £ M+, 6 < e, let D[s,e]{p) = {o' G I 5 < ~ P\\ ^ ^} 
denote the annulus in M? centered at p of radius 5 and e; it is also convenient to define Z)[o,e](p) = 
Be{p) = {q£R^\ \\q-p\\ < e} and D[s^j^^){p) = {q £ M."^ \ 6 < \\q - p\\} . Let nB,{p){q) denote the 
unit outward normal to B^{p) at q £ dBf:{p). Given a set 5 C Q, let Is denote the indicator function 
defined by ls{q) = l\iq£S, and ls{q) = if g 5. 

Throughout the rest of the paper, given a set of n distinct points V = {pi, . . . ,Pn}, we consider the 
restriction of the Voronoi partition V{V) generated by V to the convex polygon Q, {^i('P)n(5}jg{i^,,,^„}. 
For ease of exposition, we denote this restriction in the same way as the standard Voronoi partition. 
Given a tuple P = (pi, . . . ,pn) £ Q", recall that we let V = {pi, . . . ,pn} denote the associated point 
set that only contains the corresponding distinct points. 

A density function cj) : Q ^ M+ is a bounded function on Q. Given a set 5 C Q, let area^(5) 
denote the area of S measured according to 0, i.e., area^(S') = Jg(j){q)dq. A performance function 
f : R+ ^ M is a non- increasing and piecewise differentiable map with finite jump discontinuities at 
Ri, . . . , Rm £ R+, with /?!<•••< Rm- For convenience, we set Rq = and Rm+i = +oo, and write 



m.+l 
a=l 



(5) 
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where fa ■ [Ra-i, Ra] ^ a G {1, . . . ,?ti + 1} are non-increasing difFerentiable functions such that 
fa{Ra) > fa+i{Ra) for a G {1, ... , TJi} . Given a density function cj) and a performance function /, we 
consider the multi- center function 7i : M defined by 

n{P) = [ max f{\\q-p,mq)dq. (6) 

Jq ie{l,...,n} 

Note that TC is an aggregate objective function in the sense that it depends on all the locations 
pi, . . . ,Pn. It will be of interest to find local maxima for TC. Note that the performance function / 
can be defined up to a constant c G M, since 

/ ( max {f{\\q-pi\\) + c))<Piq)dq=niP)+caresi^iQ), 
and, therefore, this function and H have the same local maxima. 

Remark 2.1. Maximizing the multi-center function is an optimal resource placement problem; it is 
interesting to draw an analogy with the optimal placement problem for large numbers of spatially- 
distributed sensors. In this setting, (1) H, provides the expected value of the sensing performance 
provided by the group of sensors over any point in the environment Q, where (2) the function (j) is 
the distribution density function representing a measure of information or probability that some event 
take place over Q, and (3) / describes the utility or sensing performance of the sensors. Because of 
noise and loss of resolution, the sensing performance at point q taken from ith sensor at the position 
Pi degrades with the distance — PiU between q and pi. • 

Let us provide two equivalent expressions for the function TC over the set \ S, for S defined in 
equation 0. Using the definition of the Voronoi partition and the fact that / is non-increasing, TC 
can be rewritten as 

n „ 

^(^) = E/ fik-P^mq)dq, PeQ^\s. 

Resorting to the expression of / in (jSJ, we can also rewrite TC as 

n m+1 n 

^(^)=EE/ fMq-p^mq)dq, pgQ"\5. (7) 

We now analyze the smoothness properties of the multi-center function. 

Theorem 2.2. Given a density function cp and a performance function f , the multi-center function 
TC is 

(i) globally Lipschitz on Q^, and 

(ii) continuously differentiable on \ S, where for each i G {1, . . . , n} 

^{P)= [ ^fi\\q-p^mq)dq 

CPi JVi{P) CPi 

+ J2iURc.)-fa+l{Ra))( E / nB^jp^)iqmq)dq) , (8) 

a=l k=l ■^arCi_fc(2_Ra) 
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with aiCi^k{2Ra), k £ {1, . . . , Mi{2Ra)} the arcs in the boundary ofVi{P)nBji^{pi). 

Proof. We start by proving fact (i). Because maxjg|;^^ \\q — Pi\\ < diam((5) for all q,pi, . . . ,pn 
in Q, we can assume, without loss of generality, that Rm+i = diam(Q). Since the functions /„, 
Q G {l,...,m + 1}, are differentiable on [Ra^i, Ra], they admit a non-increasing C^-extension to 
[0, that we also denote by for simplicity. We then rewrite 7i as 

m+l „ 

nP) = y] / /a(dist((?,P))(l[o,^i^)(dist(g,P))-l[o,fi_^)(dist(g,P)),/.(g)d<?, 

where dist((?,P) = minjg|i_ „} \\q — pi\\, for P = (pi, . . G Q". Since the finite sum of globally 
Lipschitz functions is globally Lipschitz, in what follows it suffices to prove that for R G [0, Ra] and 
for Q G {1, . . . , m + 1}, the function 

na,R{P)= I /a(dist(g,P))l[o,fl)(dist(g,P))0(g)(i(7, 
JQ 

is globally Lipschitz. To this end, we introduce a useful partition of Q. For S C Q, recall = Q \ S . 
Given P = (pi, . . . P' = (p'^, . . . ,p'^), define the following sets 

Si = (Uie{i,...,„} Br{p,)') n (nie|i,...,„l B%{p[)') , 

^3 = (nie{i,...,„} bUp,)) n (n,e|i,...,„| b^(p'j) , 
^4 = (ui6|i,„„„| Br{p,)'^ n (uig|i,„„„| . 

Note that U 52 = {Ss U 54)^^ and therefore Q = 5i U ^2 U ^3 U ^4. Also, observe that Sa n = 
for any a, b £ {1,2,3,4}, a ^ b. Accordingly, we write 

n^MP) - naAP') 

4 r 

= Y. {fa(.dist{q,P)) l[o,^j)(dist(g,P)) - Udist{q,P')) l[o,fl)(dist(g, P'))) (P{Q)dq ■ 
a=l '^^'^ 

Now we upper bound each of the integrals in the above sum. For q G ^3, we have l[o,_R)(dist((7, P)) = 
and l[o,_R)(dist(g, P')) = 0, and therefore the integral over S3 vanishes. For q G 5*4, we have dist(g', P) < 
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R and dist(g,P') < R. Thus, 

(/„(dist(g,P)) l[o,fi)(dist(g,P)) - /«(dist((?,P')) l[o,i?)(dist(g,P')))</'(9)(^9 



54 



< 



< 



< 



54 



dx 

dfa 



Udist{q, P)) - /«(dist(g, P')) \ cP{q)dq 

dist(g, P) - dist((?, P') I (j){q)dq 



dx 



[0,Rc] -J Si 

IIP - P'l 

[0,Rc,] 



5-4 



(f>{q)dq < 



dfa 



dx 



[0,Rc] 



area^(Q) ||P- P'| 



where lls'Hp,/?,,] denotes the Loo-norm of g : [0, Ra] M, and ||-P — -P'|| is the Euchdean norm oi P — P' 
as a vector m M^". Here we have made use of the fact that, for all q £ Q, the map P dist(q', P) is 
globally Lipschitz with Lipschitz constant 1. For g G Si, we have 



Si 



fa{dist{q,P)) l[o,ij)(dist((?,P)) - /„(dist(g,P')) l[o,fl)(dist((?,P')))'/'(g)c?9 
\Udist{q,P))\<f)iq)dq < ||c/'||Q||/a||[o,K.] / dq 



< 



< 



Q\\fa\\[0,R^] X] 



dq 



1 ■''Sfl(p>)n(n,6{i,...,„} B^(p;)) 



n 

< ll'AllQll/a||[0,flc.] y] / dq, 

Now, we observe that, for ||pj — p^|| > R-, 

dq < ttR^ < vr diam(Q) ||pi — p'i\\ ■ 



where \\(P\\q = maXggQ 



I BRip,)nBj^{p'^) 

On the other hand, for ||pj — p'i\\ < R, Lemma iB.ll in Appendix IBl shows that 

dq < ^^^R \\pi - p[\\ < ^^|±^ diam(Q) ||pi - p'J 



Therefore, since ^^"'"^ < vr, we have 



(9) 



(10) 



Si 



Udist{q,P)) l[o,fi)(dist(g,P)) - /,(dist((7,P')) l[o,ij)(dist((Z,P')) 



< 



7r||'/'||Q||/a||[o,i?<.] diam(Q) \\pi - p-|| < ^||(/'||Q||/a||[o,i?,] diam(Q) 

i=i 



I-P-P'll. 



The integral over S2 can be bounded in an analogous fashion. Summarizing, we have proved that 
T~(-a,R satisfies 

|W«,i?(P) - naAP')\ < La,R\\P - P'W > 
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with La,R = ^U\\Q\\fa\\[o,Rc,] diam(Q) + 
ment that Ti. is globahy Lipschitz on Q^. 

Next, we prove fact (ii), that is, we prove that 7i is continuously differentiable on \ S and we 
compute its partial derivative with respect to pi. Consider the expression Q for the function TC. 
Note that for each i G {l,...,n} and a G {l,...,m+ 1}, the function {q,P) ^ faiWl — Pi\\) is 
continuously differentiable with respect to its second argument for all P E and almost all q E 
ViiP) n Note also that, for fixed P E Q", both q ^ fai\\q - Pi\\) and q ^ ^ifa{\\q - 

Pi\\)) are integrable on Vi{P) n D[R^_i^R^]iPi)- Furthermore, if P 5, then the set 



^ area0((5). This concludes the proof of the state- 



{q E Q\ 3i,j E {1, . . . ,n}, i ^ j, such that 

Ik -Pill = Ik- Pill < h-PkW for /c E {1,... ,n}\{i,j}} 

has measure zero. Therefore, {Vi{P) \ P E \ 5} is a piecewise smooth family for each i E {1, . . . , n}. 
Since for each aE{l,...,m + l}, the balls {Br^ (pi) \ P £ Q"} also define a piecewise smooth family, 
one concludes that the intersection Vi n -D[ij„_i,ij„] (k) = Vi BR^{pi) \ Vif^ BR^^^ipi), with P E 
Q'"'\S, can be written as the difference of two piecewise smooth families with strictly star-shaped sets. 
Applying now Proposition 11.61 fsee also Remark 1 1.7|1 . we deduce that each summand in equation ^ 
is continuously differentiable on \ S. We now compute its partial derivative with respect to pi, 
i E {1, . . . , n}, as 



7r^(^) = 7r E / faiWq-PilDmdq) 

rj / m+1 „ 

+ 7r EE / U\\q - PjlDmdq 



For each k E {1, . . . ,n} and each a E {1, . . . ,m + 1}, let nk^a{q) denote the unit outward normal 
to Vk{P) n BR^{pk) at q, and let ^k,a '■ x \ 5 ^ denote a parameterization for the family 
{Vfc(P) n BR^{pk) I P E \ 5}. Using Proposition 11.61 the above expression is equal to 

l^(^)= E / ^U\\q-p^\\)mdq 



a=l 

m+1 



Vi(P)nDyn^_^,R^^{pi) dpi 
+ E / / <„^/,(dist(.,K))<j4 

- y] / , , 1 ''"^V a(dist(-,pj))(/> 

m+1 „ rj 

+ EE/, , , 



o=l 
m+1 



EE/, w 4„_,^/.(dist(,p,))0, 
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where recall that dist((7,p) = For a G {1, . . . , m+l}, note that Ay (2i2Q,) = {Vi{P)riBR^{pi))r\ 

{Vj{P) n Bfi^^{pj)) 7^ if and only if pi and pj are neighbors according to the 2i?a-limited Delaunay 
graph 5ld(-P, 2i?a). In this case, there exist intervals [0^ j{P) , df -{P)] and [OJ i{P) , 0~j i{P)\ depending 
smoothly on P over an open set of \ S such that 

G G ^ HAO, P). 0€ [9-,{P), 0+ (P)] ^ 7,,c.(^, P) , 

are two parameterizations of the set (Vi(P) n Bji^{pi)) n (Vj(-P) n BR^{pj)). Resorting to the implicit 
function theorem, one can show that there exists a function h : §^ x U ^ §\ h{[6j.-{P), 6l+j(P)], P) = 
[er.{P),0+{P)], such that jj,aiO,P) = 7^,a(/i(0, P), P) for 9 G [07.(p), FVom here', we deduce 

that n*. „^ = n^., (%^^ + ^) = ^mce n,-„ and %^ are orthogonal. Therefore, if 

Pj G ^gl,o(P,2Rc.)iP^)> we have 



/, , '^U^^/a(dist(-,pi)), 



since rei,a(g) = -rij^q) and ||g - = \\q - pj\\ for all q G 9(l/j(P) n BR^{pi) n Vj(P) Pi Bji^{pj)). 
Moreover, notice that if moves, the motion — projected to the normal direction rii^a — of the points 
in the arcs {arci^i(2PQ,), . . . , arCj^^^(2i{^)(2PQ,)} C d{Vi{P)riBfi^{pi)) is exactly the same as the motion 

of Pi, i.e., ra^^^ = over arci,i(2Pa) U • • • U arCj^A,/-(2ij„)(2Pa)- Using this fact, the expression for 
the partial derivative of 7i with respect to pi can be rewritten as 

fc=l -'arCi_fc(2_RQ_i) 

The final result is a rearrangement of the terms in this equation. □ 
Remark 2.3. For a constant density function, q i— > (j)[q) = c G M+, each line integral 

arc(2_R) 

computed over the arc(2P) described by [9^ , 9^] B 9 ^ p + P(cos 9, sin 9) gM?, equals 
cK / (cost7,smt7jat7 = 2c/tsml 11 cos I ),sm 



For particular choices of performance function, the corresponding multi-center function and its 
gradient have different features. We here explore some interesting cases: 
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Centroid problem: If the performance function / is piecewise differentiable with no jump 
discontinuities, then all the terms in the second summand of equation (jSj) vanish and one 
obtains 



l^(^)= / -^f{h-P^\\)mdq■ 
dpi JvdP) 9pi 



lv,{P) 

This is the result known in the locational optimization literature [12, 16, 19]. In particular, if 
f{x) = — x^, the multi-center function H reads 

n „ n 

np) = -Yl / h-p^\Uiq)d<l = -Y.'^y"P^^ 

i=l Jy^^P) r=l 

where Jw,p denotes the polar moment of inertia of the set C Q about the point p. Addi- 
tionally, the gradient of TC is 

^{P) = 2 [ {q-pi)mdq = 2 Mv^(p) (CMy^(p) -p,) . 
OPi JVi{P) 

Here Mw and CM14/ denote, respectively, the mass and the center of mass with respect to the 
density function (p of the set W G Q. The critical points of 7i are configurations P € Q"" such 
that Pi = CMy.(p) for all i G {l,...,n}. Such configurations are called centroidal Voronoi 
configurations, see [16]. 

Area problem: On the other hand, if one takes f{x) = l[Q p](x), the indicator function of the 
set [0, R], then the multi-center function TC corresponds to the area, measured according to (p, 
covered by the union of the n balls Br{pi), . . . , BR{pn), that is, 

niP) = area<^(U[LiSp(pi)) ■ 
In this case, the first term in equation Q vanishes and one obtains 

Mi(2R) 

/arci,fc(2fl) 



dn ^ f 



Given a configuration P G Q", if the ith agent is surrounded by neighbors in the graph 
^ld(-Pi 2i?) in such a way that Mi{2R) = 0, then the multi-center function TC does not depend 
on Pi. This situation is depicted in Figure 01 (see example on the right) and captures the fact 
that the total area covered by the agents is not affected by an infinitesimal displacement of 
the ith agent. 

Mixed centroid-area problem: Consider the case when the function / is given hy x 
— l[o,_R)(a^) + b • l[_R,-i-oo)(2;)i foi' b < —P?. The multi-center function then takes the form 

n 

T-^iP) = -Yl ■^vaP)nBn{Pi),Pi + b area<^(Q \ U'l^iBR{pi)) , 
1=1 
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and its partial derivative with respect to the position of the ith agent is 

(P) = 2My^(p)nB«(po(CMy,(P)nBfl(pO -Pi) - (R^ + b) ^ / nB^(p^) 



dp, 



In the particular case when b = —B?, the function x i— > /(x) = —x^ l[o,_R)(a;) — B? • \r^+oo){^) 
is continuous and therefore the gradient of 7i takes the form 

31~L f 

7r-(^) = 2 / {q- Pi)(t>{q)dq = 2Mv^^P)nBR{p^){CMv^(P)nBnip^) -Pi) ■ 

OPi JViiP)nBR(p,) 

Note that, in this case, the critical points of 7i are configurations P G such that pi = 
CMy.(p)piB^(p.) for all i £ {1, . . . ,n}. We refer to such configurations as R-centroidal Voronoi 
configurations. For R > diam((5), i?-centroidal Voronoi configurations coincide with the 
standard centroidal Voronoi configurations over Q. 
We can now characterize the results in Theorem 12.21 in terms of the notion of spatially-distributed 
computations introduced in Section [1.21 

Corollary 2.4. Let (j) and f he a density and a performance function, respectively. The gradient ofTC 
with respect to the agents' location P E Q" is spatially distributed over the Delaunay graph Qj){P). 
Furthermore, if f{x) = b for all x > R, then the gradient ofTi with respect to the agents' location is 
spatially distributed over the 2R-limited Delaunay graph Qi,d{P,2R). 

Proof. In general, the partial derivative of 7i with respect to the ith agent (cf. equation Q) depends 
on the position pi and on the position of all neighbors of in the graph ^q. If, in addition, /(x) = 5, 
for all x > R, then necessarily R^ < R, a £ {1, . . . , m}, and 

/ ^fi\\q-PimQ)dq= [ ^ f {\\q - P.lDmdq ■ 

Jv,{P) Opi Jv^{P)nBa(p,) opi 

Therefore, the expression for dTi/dpi in equation © can be computed with the knowledge pi and of 
its neighbors in the graph Gld{P,2R). □ 

This corollary states that information about all neighbors in Gj) is required for objective functions 
Ti corresponding to arbitrary performance functions /. In the next proposition we explore what can 
be done with only information about the neighbors in the 2i?-limited Delaunay graph Gi^d{2R). 

Proposition 2.5. Let f be a performance function and, without loss of generality, assume /(O) = 0. 
For r g]0, 2diam((5)], define the performance function fr : — > M given by /r (x) = f{x) for x < ^ 
and fzi^x) = /(diam((5)) for x > |. LetTLr. be the multi- center function associated to the performance 



function fr. Then, for all P G Q", 

nr{p)<n{p)<pnr{p)<o, (iia) 

Tir (P) <n{P)< Tir (P) + n(P) , (lib) 

"'^ere P = jJSim) ^ ^^'^ n : Q" ^ [0,k] C R, U{P) = (/(§) - /(diam(Q))) area^Q \ 

U^^.BrJp,)), with K = (/(§) - /(diam(Q)))area^(g). 
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Proof. Clearly, /r is a performance function as it is non-increasing and piecewise differentiable with 
finite jump discontinuities. Let b = /(diam(Q)) and note that f{x) > b for all x G [0, diam((5)]. By 
construction, it is clear that < f{x) for all x £ [0, diam((5)]. Since \\q — p\\ < diam((5) for all 

q,p £ Q, we conclude that Ti.^{P) < 'H{P)- Now, consider the function /(x) = ()f^{x). Note that 
/(x) = I3f{x) > fix) for X < §, and f{x) = /36 = /(§)> /(x) for x > §. Therefore, 

pnr (P)= [ max /(||g-K||)0(g)dg> / ma^ f{\\q - pi\\)<P{q)dq = n{P) , 

^ 7Q«G{l,...,n} J Q i&{l,...,n} 

which concludes the proof of the first chain of inequalities. To prove the second chain of inequalities, 
consider the difference 

n „ 

n{P)-nr{P)=Y^ / {f{\\q-p^\\)-b)mdq. 
~iJv.{P)n{Q\Br(p,)) 

For q G Vi{P)r\ {Q\Br[p^))^ the non-increasing property of / implies that f {\\q — Pi\\) — b < f{^) — b. 
Therefore, 

n{P) -nr {p)<j2 [ (/(§) - mQ)dq = [ (/(§) - b)mdq = n(p) . 

□ 

Remark 2.6. The inequalities in (|1H) provide, respectively, constant-factor and additive approxima- 
tions of the value of the multi-center function TC by the value of the function TCr . These approximations 
will play an important role in Section when we discuss the continuous and discrete-time implemen- 
tations of spatially-distributed coordination algorithms. • 

The next result provides one more useful indication of the relationship between multi-center func- 
tions associated to certain performance functions. 

Proposition 2.7. Let f and fr be performance functions, andTi. andTir be the corresponding multi- 
center functions, defined as in Provosition \2.^ Let P* = {p\, . . . G be a local maximum ofTCz 
such that Q C Ujg|i^,,,^„}i?| (p*). Then 7i{P*) = 7i^{P*) and P* is a local maximum of the aggregate 
objective function 7i. 

Proof If Q C Ujgji ... (p*), then from equation Hllb|) we deduce that TC{P*) = 7ir (P*). Moreover, 
one can also show that Vi{P) C Br [p*) ior all i e {1, ... ,n}, and therefore Vi{P) = Vi{P) n Br[p*). 
As a consequence, the r-limited Delaunay graph GhD{P*,r) and the Delaunay graph ^d(-P*) coincide, 
and the gradients of both H and Hl vanish at P*. □ 

° 2 

The importance of Proposition 12 . 71 lies in the fact that, by following the gradient of the function Tir 
(where, along the evolution, the inclusion Q C Ujgji (pi) may not be verified and each agent 

only operates with the knowledge of (i) the positions of other agents up to a distance r of its own 
position, and (ii) the events taking place at up to distance | of its own position), the agents may 
eventually find a local maximum of the original multi-center function 7i. 
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We end this section by presenting a useful result in the 1-center case, i.e., when there is a single agent 
(n = 1). For a convex polygon W, define the function 7ii{p, W) = f{\\<l — p\\)4'{<l)dq- The following 
lemma proves that the points in the boundary of W are not local maxima of W) : ^ M. 

Lemma 2.8. LetW be a convex polygon, and consider the function 7ii{-,W) : — > M. LetpoGdW. 
Then the gradient ofTCi at po is non-vanishing ^-^^j-^(po) 7^ 0, and points toward mt{W). 

Proof. The function p i-^ 'Hi{p, W) is differentiable over W, and its derivative is given by 



. [ ^fih- Pmq)dq + £ / ni^/„(dist(-,^,)) ^ 

- y] / "Li ;?~V a(dist(-,p)) 0. 

±i JaiWnB„_ op 



-1 ^9(WnB«_^(rt) 

Let M{Ra) > denote the number of distinct arcs arci (2/?^ ),..., arc A//(R^)(2i?a) of radius Ra in 
d(W n Br^^p)). After some simplifications, we rewrite the expression for the gradient at po as 



a=l 1=1 



JVK 119 -poll TTT Jwci{2Rc] 



where denotes the outward normal to Bji^{pQ). Since W is convex, it is defined as the intersection 
of some hyperplanes Hi, . . . , via the equations H(^{q) = A(^q + 6^ > 0, where is a 2 x 2-matrix 

and 6^ G M, for G {1, . . . , d}. To show that — ^(po) 7^ and points toward int(Vl^), we consider 
its inner product with the direction given by the each line A(^^q + =0 such that H(^^{po) = 0. Let 
us therefore consider 

^c. - / f'i\\q-po\\)Y-^<Piq)dq + Y.^U{Ra)-fa+i{Ra))Yl / ""'^ 

y Il9-P0|| ^ ^ Arq{2R<,) ^ 

= -/ /(Ik - PoiD ^i^-' ^ V mdq + f:(/.(i?.) - ^ / %i7^ 

ivy Ik -Poll fr^ f-^ iarc,(2flc.) dlSt(-,^)o) 



where we have used the fact that na{q) = (q — Po)/lk — Poll for each q £ d{W n Br^{pq)). Since 
the function / is non-increasing, then its derivative is negative almost everywhere, and the jump 
discontinuities fa{Ra) — fa+i{Ra) are positive for all q G {1, . . . , m}. Finally, note that A(^^q + hQ^ > 

in the interior of W. Therefore, we conclude that A/^^ (^~^^r^(Po)^ > for all C* such that H^^ (j>o) = 
0, i.e., — ^ — ^(Po) / and points toward int(VF). □ 

3. Design of spatially-distributed algorithms for coverage control 



In this section, we develop continuous and discrete-time implementations of the gradient ascent for 
a general aggregate objective function Ti. 
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3.1. Continuous-time implementations 

Assume the agents' location obeys a first order dynamical behavior described by 

Vi = Ui. 

Consider 7i an aggregate objective function to be maximized and impose that the location pi follows 
the gradient ascent given by Q- In more precise terms, we set up the following control law defined 
over the set \ S 

«. = f(P). (13) 

where we assume that the partition V{P) = {Vi, . . . , Vn} is continuously updated. One can prove the 
following result. 

Proposition 3.1 (Continuous-time Lloyd ascent). Consider the gradient vector field on Q'^\S defined 
by equation ()13|) . Then 

(i) For a general performance function f , the gradient vector field is spatially distributed over 
the Delaunay graph Q-oiJ^). If, in addition, the performance function verifies f{x) = b for 
all X > R, then the vector field is spatially distributed over the 2R-limited Delaunay graph 

gi,B{P,2R). 

(ii) The agents' location evolving under starting at Pq £ \ S remains in \ S and 
converges asymptotically to the set of critical points of the aggregate objective function 7i. 
Assuming this set is finite, the agents' location converges to a critical point ofTC. 

Proof. The statement (i) is a transcription of Corollary 12.41 To prove the statement (ii), let t S 
M+ 1-^ P{t) G denote the solution to the initial value problem pi = -q^{P), i G {l,...,n}, 
P(0) = Pq. We reason by contradiction. Assume that there exists t* G M+ and i,j G {1, . . . ,n} such 
that Pi{t^) = Pj{t^:), i.e., ^(t*) G S. Let v be the direction given hy v = liuit^t, y ft)-p'\t) \\ ■ 
e > sufficiently small such that, for all t G]t* — e,t^:[, Pi{t) and Pj{t) are neighbors in the graph 
Q'L'D{P{t)-,'r). Then one can show that 

lim — ^(P(t)) > 0, • lim — ^(P(t)) < 0. (14) 

t^u dpi t~*t, dpj 

Indeed, if n denotes the orthogonal line to v, and Hi^n and Hj^n denote the associated hyperplanes 
having v pointing inward and outward respectively, then, reasoning as in the proof of Lemma l2.81 one 

dHr dHr 

proves that linit^t^ -^{P{t)) points toward mt{Vi{P{t^))nBr{p^{t^))nHi^n), and limj^j^ -^(P(t)) 
points toward int(V^(P(t^,))ni?r (pj(i^))niifj^ri)- Prom equation (fTl)) . we deduce that for all t sufficiently 
close to t^, we have {pi{t) —pj{t)) ■ {pi{t) — pj{t)) > 0, which contradicts P(t*) G S. One can resort to 
a similar argument to guarantee that there is no configuration belonging to S in the cj-limit set of the 
curve 1 1— > P{t). The convergence result to the set of critical points of TIl is an application of LaSalle 
Invariance Principle [24]. □ 

Remark 3.2. Note that this gradient ascent is not guaranteed to find the global maximum. For 
example, in the vector quantization and signal processing literature [18], it is known that for "bimodal" 
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distribution density functions, the solution to the gradient flow reaches local maxima where the number 



In a practical setting, the sensing and/or communication capabilities of a network agent are re- 
stricted to a bounded region specified by a finite radius r > 0. Therefore, instead of maximizing 
the multi-center function 7i, we set up the continuous-time algorithm given by equation with 
the function Ti.L- This latter algorithm has the advantage of being spatially distributed over the r- 
limited Delaunay graph GhDiP, f), and providing an approximation of the behavior for the multi-center 
function (cf. Proposition I2.5|l . 

3.2. Discrete-time implementations 

We start by reviewing some notions on discrete-time algorithms following [25] . An algorithm on 
is a set-valued map r:Q"^2Q". Note that a map from to can be interpreted as a singleton- 
valued map. For any initial Pq G Q"', an algorithm T generates feasible sequences of configurations in 
the following way: given P„ G Q", the map T yields T{Pn) C Q". Prom this set, an arbitrary element 
Pn+i may be selected. In other words, 



An algorithm T is said to be closed at P £ Q" if for all convergent sequences Pk P, P'j. ^ P' such 
that G T{Pk), one has that P' G T{P). An algorithm is said to be closed onWc Q" if it is closed 
at P, for all P G W. In particular, every continuous map T : Q" — > is closed on Q". A set C is 
said to be weakly positively invariant with respect to T if for any Pq £ C there exists P G T{Pq) such 
that P £ C. A point P, is said to be a fixed point of T if P, G T{P^). Let [/ : ^ M. We say 
that [/ is a Lyapunov function for TonWii (i) U is continuous on W and (ii) U{P') < U{P) for all 
P' G T(P) and all PeW. 

We now turn to the design of discrete-time algorithms for limited-range coverage control. We start 
by extending the definition of the aggregate objective function 7i to consider general partitions W of 
Q as follows. Let P G and let W = {Wi C Q}^=i be a partition of Q such that Wi is a convex 
polygon and pi £ Wi, for i G {1, . . . , n}. Define the function 



The function Tie is differentiable with respect to its first variable for all P G Q", and its partial 
derivative is given by 



of agents allocated to the two region of maxima are not optimally partitioned. 



Pn+i G r(p„,) 



n G NU{0}. 



(15) 







(16) 
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where for each k G {1, . . . , n} and each a £ {1, . . . , m + 1}, Uk^aio) denotes the unit outward normal 
to Wk n Bji^{pk) at q, and 'yk,a '■ §^ x denotes a parameterization for the piecewise smooth 

family {Wk H Bji^{pk) \ P G Q^}- Note that, using the definition of Hi (cf. Section one can also 
write 

n 
i=l 

The following two equalities hold 

n{P) = HeiP, V(P)) , for ah P e Q"" , (17) 
^(P,V(P)) = ^(P), foraUPGQ"\5. (18) 

Let P £ S and consider a partition W = {Wj C of Q such that Wj is a convex polygon 

and Pi G Wj, for i G {1, . . . Let io,jo G {1, • • • 7^ Jo such that pi^ = pj^. Then, following 

Remark ll.3| Vig{P) = Vjg{P), and V{P) is no longer a partition of Q, but a covering. Nevertheless, one 
could consider the line determined by the edge Wi^ n Wj^ and the associated hyperplanes -f^jo,VK,(,nM/jn 
and Hjg^w.gHWjg such that Wi^ C Hig^w.^nW-jg and VFjo C Ifjo^iy^^nWjo • With a slight abuse of notation, 
redefining 

V,, (P) = V,, (P) n H,,,w,^nw,, , V,, (P) = V,, (P) n H,,^w.,nw,, , 

the collection V{P) can be seen a partition of Q. This procedure can be extended if there are more 
than two coincident agents {ii, . . . , is} at a point p £ Q hy defining 

Vi, (P) = Vi^ (P) n ( n^6|i,...,,}\|^| Hi^^w^^nw,, ) , /i G {1, . . . , s} . 

Li the following, such a construction will be tacitly performed whenever we have a configuration P £ S 
and a partition W of Q. 

The following lemma shows that the Voronoi partition is optimal within the set of partitions of Q. 

Lemma 3.3. Let (j) and f be a density and a performance function, respectively. Let P G and 
consider a partition W = {Wi C of Q such that Wi is a convex polygon and pi G Wi, for 

i G {1, . . . , re}. Then 

'He{P^W)<He{Py{P)), 

and the inequality is strict if f is strictly decreasing and the partitions V{P) and W differ by a set of 
non-zero measure. 

Proof. Given the chain of implications q G Vj{P) ^ \\q — pi\\ > ||g — pj\\ ^ f{\\q — Pi\\)(l){q) < 
fih-Pj\\)HQ)i we compute 



n n „ 

ne{p,w)=J2E 



f{h-p^\\)mdq 



n n I. 

< EE / f{\\q-p,\\)mdq = ne{PMP)). 



-.1 j=l''W,nVi{P) 
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□ 

We are now ready to characterize a class of algorithms with guaranteed convergence to the set of 
critical points of the aggregate objective function 7i. 

Proposition 3.4 (Discrete-time ascent). Let T : — > 2*^" be an algorithm closed on Q"'\S satisfying 
the following properties: 

(a) for all P £ Q", T{P) n 5 = 0; 

(b) for all PeQ^\S,P' e T{P) and i G {1, . . . rLi{p[, V,{P)) > HM, Vi{P)); 

(c) for allPGS and P' G r(P), > 7^(P); 

(d) if P £ \S is not a critical point ofTi, then for all P' G T{P), there exists j G {1, . . . ,n} 
such that niip'j,Vj{P)) > ni{pj,Vj{P)). 

Let Pq G denote the initial agents' location. Then, any sequence {P„ | n G NU {0}} generated 
according to equation ()15|) converges to the set of critical points ofTC. 

Proof. Consider —7i : — > M as a candidate Lyapunov function for the algorithm T on \ S. 
Because of Lemma 13.31 we have 

n{p') = ne{p',v{p'))>ne{p',v{p)), 

for all P' G T{P). In addition, because of property (b) of T, we also have 

HeiPWiP)) > ne{p,v{p)) = niP) , 

for all P' G r(P). Hence, n{P') < n{P) for all P' G T(P) and ah P G Q". Therefore, we 
deduce that —7i is a Lyapunov function for the algorithm T. Let Pq G \ S and consider a 
sequence {P„ I n G N U {0}} generated according to equation (|15|). Because of property (a) of T, 
{Pn I n G NU {0}} remains in \ S C Q^. Since is compact, we conclude that the sequence 
is bounded. Now, the application of the discrete-time LaSalle Invariance Principle (see Appendix ICj 
Theorem IC.1|) guarantees that there exists c G M such that P„ ^ M n 7i~^{c), where M is the 
largest weakly positively invariant set contained in {P' G | 3P' G T{P) such that 7i{P') = 7i{P)}. 
Properties (c) and (d) of T imply that M must be contained in the set of critical points oi TC. If 
Pq G S, the sequence {Pn | n G N U {0}} can be equivalently described by {Pq} U {Pn \ n G N}. Since 
Pi £ Q"" \ 5 by property (a) of T, the previous argument implies that the sequence converges to the 
set of critical points of TC. □ 

In what follows, we devise a general algorithm T : — > 2*5" verifying properties (a)-(d) in Propo- 
sition 13.41 We shall do so by designing a discrete-time version of the gradient ascent algorithm for 
continuous-time settings. 

Recall that Lemma 12.81 asserts that if pq G dW , then — — {Po) 7^ points toward the interior 

of W. If po £ int(VF) is not a critical point, then one also has that —^^7—^(^0) 7^ 0. For both cases, 
there exists e = e{po, W) > such that the point ps defined by 

P5=Po + S ^'^g^^\ po)eW 



has the property that Tiiips) > 'Hi{po), for all 6 G (0, e), and 7ii{pe) = 7ii{po). As it is usually done 
in nonlinear programming [25], the computation of the step-size e can be implemented numerically via 
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a "line search". With this discussion in mind, let us define the line search algorithm T\s : Q" 
as follows: 

Given P G Q", let P' G 7is(P) if, for i G {1, . . . ,n} with the property that Pi / 
Pj,j G {'^,---,n'}\{i}, 



2Q- 



Pi=Pi + 



^^"■':^-'^»(p.).withie 



dp 



e{puV,{P)) e{pMP)) 



(19) 



and, for each set {ii, 



is} of coincident indexes at a point p £ Q, 

e{pi,Yi) eipi,Yi) 



with 6 G 



where {1^^ , . . . , Yi^ } is a partition of V^^ (P) 
/z G {1, . . . 



3 2 
Vi^(P) verifying p £ Yi for 



(20) 



Proposition 3.5. The algorithm Tjs : ^ 2'^" defined by equations (|19 |) - (|2U|) is closed on Q" \ S, 
and verifies properties (a)-(d) in Proposition 

Proof. The fact that Tis is closed on \ S follows from its definition and the continuous dependence 
of e(p, V{P)) on P G \ S. Regarding the properties in Proposition 13. 4| consider the following 
discussion. Let P G and consider P' G T\s{P). On the one hand, equation (|19|) and the definition 
of e{p,V{P)) implies that p[ G int(Vi(P)) for each i G {l,...,n} such that pi / pj for all j G 
{!,... , n}\{i}. On the other hand, equation (|2()|1 and Lemma \2 . 81 implies p'- G int(Yi^). Therefore, we 
deduce that P' 5, and property (a) is verified. Using equation (fT9|l . one has that for all P G Q"'\S, 
P' G ris(P) and all i G {l,...,n}, Wi(p^,yi(P)) > Wi(pi, Fi(P)), i.e., the algorithm Ti^ verifies 
property (b). With respect to property (c), let P £ S. For simplicity, we only deal with the case when 
there exists i, j G {1, . . . , n}, i 7^ j such that pi = pj, and all other Pk 7^ Pi = Pj, k & {1, • • • 1 '^l \ {hj} 
are distinct among them (the cases with more degeneracies are treated analogously). Let P' G T{P). 
According to equation we have 

n{p)= ni{pk,Vk{P))+ni{puYi)+ni{pj,Yj), 

fcG{l,...,n}\{i,j} 

where {Yi,Yj} is a partition of Vi{P) = Vj{P) with pi £ Yi and pj £ Yj. Since necessarily pi £ dYi 
and Pj £ dYj, Lemma ITSl imphes that Hi{pi,Yi) + Tli{pj,Yj) < 'Hi{p^,Yi) + Hi{p'j,Yj). Therefore, 
7^(P) < 7i{P'), i.e., property (c) is verified by Ti^. Finally, if P G \ 5 is not a critical point of TC, 
then there must exist i £ {1, . . . , n} such that 

|^(P) = f^(P,V(P))#0. 
OPi opi 

Equivalently, pi is not a critical point of 7ii{-, Vi{P)) : Vi{P) M, and therefore e{pi, Vi{P)) > 0. By 
equation we conclude that ni{p'i,Vi{P)) > Hi{pi,Vi{P)) for all P' £ Ti^iP), i.e., the algorithm 
Tis verifies property (d). □ 

Corollary 3.6. Consider the algorithm Tis : 2'^" defined by equations (fT^ - ipU)) . T/ien 



24 



DISTRIBUTED COVERAGE OPTIMIZATION AND CONTROL WITH RANGE-LIMITED INTERACTIONS 



(i) For a general performance function f , the algorithm Tis is spatially distributed over the De- 
launay graph Qd{P)- If, in addition, the performance function verifies f{x) = b for all x > R, 
then Tis is spatially distributed over the 2R-limited Delaunay graph ^LD(-P>2i?); 

(ii) The sequence of agents' locations generated by Tis according to equation (|15|) starting at Pq S 
Q^, converges asymptotically to the set of critical points of the aggregate objective function TC. 

Proof. The statement (i) is a direct consequence of Corollary 12.41 The convergence result is a conse- 
quence of Propositions E3] and EISl n 

Remark 3.7. As we noticed in Section [3. 11 in a practical setting, the network agents have typically 
a limited sensing/communication radius r > 0, and therefore, following the result in Proposition 12.51 
we seek to maximize the function TCl. • 

2 

In certain cases, it might be possible to construct specific algorithms tailored to the concrete ag- 
gregate objective function at hand. A relevant example of this situation is when the local maxima of 
the function TCi^-, W) can be characterized for each fixed polygon W. With this discussion in mind, 
let us define the max algorithm Tmax • 

Qn _^ 2^" as follows: 

For P G Q" \ 5, let 

rmax(i^) = {P' G I is a local maximum of Vi{P)) , for i G {1, . . . , n}} . (21) 

If P £ S, for each set {ii, . . . , ig} of coincident indexes at a point p £ Q, let p[^^ be 
a local maximum of TCi{-, i^i,J, where {1^^, . . . , 1^^} is a partition of Vij(P) = • • • = 
Vi^ (P) verifying p E , for ^ G {1, . . . , s}. 

One can show that T^ax is closed on Q'^\S and verifies properties (a)-(d) in ProDosition l3.4l As before, 
the algorithm Tmax is spatially distributed over the Delaunay graph GuiT') and, if the performance 
function is /r, then Tmax is spatially distributed over the r-limited Delaunay graph GhuiP,''')- 

It is worth noticing that Lemma 12.81 guarantees that the local maxima of W) are not in the 
boundary of W, and therefore are contained in the set S W \ ^'^gp'^'* {p*) = o|. Moreover, if / 
is concave, then TCi is also concave, as stated in the following lemma. 

Lemma 3.8. If f : — > M is concave, then 7ii is concave. 

Proof. For fixed q £ Q, the map p ^ f{\\q — p\\)(l){q) is concave; the integral with respect to g of a 
map with this property is concave in p; see [26, Subsection 3.2.1]. □ 



As a consequence, the set of global maxima of TCi{-,W) is compact, convex and characterized by 
the equation 

In particular, these conditions are met in the centroid problem introduced in Section |2 where f{x) = 
—x^ is concave and the unique global minimum of is the centroid CMyi/ of W . In this case, 

the algorithm T^ax is precisely the Lloyd quantization algorithm [9,16,18]. 



DISTRIBUTED COVERAGE OPTIMIZATION AND CONTROL WITH RANGE-LIMITED INTERACTIONS 



25 



4. Simulations 

To illustrate the performance of the coordination algorithms, we include some simulation results^. 
The algorithms are implemented in Mathematica as a library of routines and a main program running 
the simulation. The objective of a first routine is to compute the intersection of the bounded Voronoi 
cell Vi with the ball BL{pi), for i G {!,..., n}, and to parameterize each set Vi n Br(j)-) in polar 
coordinates. The objective of a second routine is to compute the surface integrals on these sets and 
the line integrals on their boundaries via the numerical integration routine NIntegrate. We paid 
careful attention to numerical accuracy issues in the computation of the Voronoi diagram and in the 
integration. 

We show executions of the discrete-time algorithm Tis (cf. equations H19|) - (|2m) ) for the centroid 
problem, the area problem, the mixed centroid-area problem with continuous sensing performance, 
and the mixed centroid-area problem with discontinuous sensing performance in Figs. ^ El El and [71 
respectively. Measuring displacements in meters, we consider the domain Q determined by the vertexes 

{(0, 0), (2.125, 0), (2.9325, 1.5), (2.975, 1.6), (2.9325, 1.7), (2.295, 2.1), (0.85, 2.3), (0.17, 1.2)}. 

The diameter of this domain is diam((5) = 3.37796. In all examples, the distribution density function </> 
is the sum of five Gaussian functions of the form 5 exp(6(— (x — a^center)^ ~ {v ~ ycontcr)^)) and is 
represented by means of its contour plot. The centers (xcentor, ycentor) of the Gaussians are given, 
respectively, by (2, .25), (1,2.25), (1.9,1.9), (2.35,1.25) and (.l,.l). Measured with respect to 0, the 
area of the domain is aiea,^{Q) = 8.61656. Unless otherwise noted, each agent operates with a finite 
sensing/communication radius equal to r = .45. 

Figure 4. Centroid problem (with agent performance f{x) = —x^): discrete-time 
algorithm for 16 agents on a convex polygonal environment. The left (respectively, 
right) figure illustrates the initial (respectively, final) locations and Voronoi partition. 
The central figure illustrates the gradient ascent flow. After 90 seconds, the value of 
the multi-center function is approximately —.321531. 



Figure 5. Area problem (with agent performance f{x) = ljo,r](2;)): discrete-time 
algorithm for 16 agents on a convex polygonal environment. The left (respectively, 
right) figure illustrates the initial (respectively, final) locations and Voronoi partition. 
The central figure illustrates the gradient ascent flow. For each agent z, the intersection 
Vi n B^{pi) is plotted in light gray. After 18 seconds, the value of the multi-center 
function is approximately 6.28977. 

The execution of the coordination algorithm in Figure [71 (with radius r = .45, agent performance 
/r(a;) = — 1[q r^(x) — diam((5)^ • Ijr _|_oo)(x) and corresponding multi-center function 'Hii) can be 
regarded as a limited-range implementation of the gradient ascent of the multi-center function 7i 



Due to the limited size of the submissions to the arXiv e-print server, we could not include here the figures. The 
interested reader is referred to http://motion.csl.uiuc.edu for the complete preprint version with all figures. 
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Figure 6. Mixed centroid-area problem (with continuous agent performance f{x) = 
—x^ l[0,i)(2;) — ^ • l[i:^_|_oo)(3;)): discrete-time algorithm Tis for 16 agents on a con- 
vex polygonal environment. The left (respectively, right) figure illustrates the initial 
(respectively, final) locations and Voronoi partition. The central figure illustrates the 
gradient ascent flow. For each agent i, the intersection Vi n B^{pi) is plotted in light 
gray. After 90 seconds, the value of the multi-center function is approxima- 
tely -0.252534. 



Figure 7. Mixed centroid-area problem (with discontinuous agent performance f{x) = 
—x^ l[o,i;)(a;) — diam(Q)^ • \^l^j^oo){x))'- discrete-time algorithm Tis for 16 agents on a 
convex polygonal environment. The left (respectively, right) figure illustrates the initial 
(respectively, final) locations and Voronoi partition. The central figure illustrates the 
gradient ascent flow. For each agent z, the intersection Vi n Bi_(j)i) is plotted in light 
gray. After 13.5 seconds, the value of the multi-center function is approximately —6.803. 



corresponding to the agent performance f{x) = — (cf. Figure this performance function does 
not have any range limitation. According to Proposition 12.51 we compute 

= = -( - V ?5i 004437 

^ /(diam(Q)) 4 Vdiam(Q) ) ^•^"^^'^^ ' 

n(Pfinai) = (/(i) - /(diam(Q))) area^(Q \ \j'UBr.{vi)) « 26.5156, 

where Pfinal denotes the final configuration in Figured From the constant-factor approximation (|lla)) 
and the additive approximation Hllb|) . the absolute error is guaranteed to be less than or equal to 
min{(/3 — 1)"^! (-Pfinai)) n(Pfinai)} ~ 6.77282. In order to compare the performance of this execution 
with the performance of the discrete-time algorithm in the unlimited-range case, i.e., for the case of 
f{x) = — (cf. Figure|lJ), we compute the percentage error in the value of the multi-center function TL 
at their final configurations. This percentage error is approximately equal to 30.7%. 

Figure |H1 below shows another execution of the discrete-time algorithm Tis for the mixed centroid- 
area problem with discontinuous sensing performance, where now the sensing/communication radius 
is taken equal to r = .65. In this case, the percentage error with respect to the performance of the 
discrete-time algorithm in the unlimited-range case is approximately equal to 23%. As expected, the 
percentage error of the performance of the limited-range implementation improves with higher values 
of the ratio gj^^. 



Figure 8. Execution of the discrete-time algorithm in the same setting as in Fig- 
ure [71 but with a sensing/communication radius equal to r = .65. After 13.5 seconds, 
the value of the multi-center function is approximately —1.10561. 
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5. Conclusions and future work 

We have presented novel spatially-distributed algorithms for coordinated motion of groups of agents 
in continuous and discrete time. Avenues of possible future research include (1) distributed implemen- 
tation of deterministic annealing techniques [27] (methods which promise to overcome local maxima), 
(2) visibility-based algorithms for coverage in non-convex environments, and (3) distributed algorithms 
for other cooperative behaviors and sensing tasks, e.g., detection, estimation, and map-building. 

This material is based upon work supported in part by ARO Grant DAAD 190110716, ONR YIP Award 
N00014-03-1-0512, and NSF SENSORS Award IIS-0330008. Sonia Martinez's work was supported in part by a 
Fulbright PostDoctoral Fellowship from the Spanish Ministery of Education and Culture. 
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Appendix A. Proof of Proposition II. bl 

Proof. Let xq £ {a,b). Using the fact that the map 7 is continuous in both its arguments and that 
^{xq) is strictly star-shaped, one can show that there exist an interval around xq of the form X^o — 
{xq — e, Xq + e), a smooth function '■ S"^ x M_|_ — > and a function r^Q : x I^.^ — > M-f smooth in x 
and piecewise smooth in 6 such that for all x E , one has Q{x) = Ugggi {uxq s) | < s < {0, x)} 
and Uxo{9,rxo{0,x)) = 7(0, x), for 9 G S^. For simplicity, we denote by r and u the functions Vx^ and 
UxQ , respectively. By definition, the function in @ is continuously differentiable at xq if the following 
limit exists 



lim — 



tI [ (t){q,xo + h)dq- [ (l){q,xo)dq\ 

\Jn{xo+h) Jn{xo) ) 



and depends continuously on xq. Now, we can rewrite the previous limit as 



r2-K / rr{9,xo+h) 

lim - / / (j){u{9,s),xo + h) 



du du 
m^'ds 



r{0,xo) 

ds - I 4){u{9 , s) , Xq] 





2 r2-K / rr{9,xo+h) 

r / / (t){u{9,s),XQ + h) 

h^O n Jq \Jr{e,xo) 



du du 
'd9^~d~s 



ds 



+ 



r{0,xo) 



du du 
'ds 



ds d9 



{u{9, s), xo + h)- (j){u{9, s), xo)) 



du du 
d9^'ds 



ds\d9. 



where x denotes the vector product and for brevity we omit that the partial derivatives ^ and ^ 
are evaluated at {9,s) in the integrals. Now, since 



lim - (j){u{9, s),xo + h) - (t){u{9, s), xq) 
/i->o n 



du du 
'd9 ^ 'dl 



— {u{9,s),xo) 
dxo 



du du 
d9^ 'ds 
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almost everywhere and because this last function is measurable, the Lebesgue Dominated Convergence 
Theorem [28] implies that 



2 j-2-K i-r{8,xo) 

lim - / 



{u{9, s),xo + h) - (t){u{6, s),xo)) 

r2TT fr{e,xo) 

—{u{e,s),xo) 



Jo 



du du 
89 ^'ds 
du du 
'89 ^ 'ds 



dsd9 



^«^^= / ^{q,xo)dq. (22) 



On the other hand, using the continuity of (p, one can deduce that 



lim — 



h Jq Jr(e,xo) 



8u 



8u , 



'u{9,s),xo + h) -g^i0,s)x—{9,s 



lim 



h^o h Jq J^^ 



8s 

2tt rxn+h q o <^ 

M0,r{9,z)),xo + h) —{9,r{9,z))x—i9,r{9,z)) —{9,z)dzd9 



ds d9 



8s 



8x 



2-K 



011 fill (jT 

iui9,ri9,xo)),xo) —{9,r{9,xo))x—{9,r{9,xo)) ^^{9,x^)d9. 



Since 7(0, x) = u{9, r{9, x)) for all 9 £ and x £ Z^g, one has 

= (.,x„))|(«,.„). 

Let X denote the angle formed by ^{9,xq) and ^{9,r{9,xo)). Then (omitting the expression 
{9,r{9,x)) for brevity). 



8u 8u 
'd9^'ds 



/ 8u 8u 8r \ 8u 
\d9^d^d9)^d^ 





dj 




du 


s'mx = 


O7 




d9 




ds 


89 



n*(7) 



8u 
8s 



where in the last inequality we have used the fact that, since 'Jxq is a parameterization of 5il(xo), then 
sinx = cos'0, where ip is the angle formed by n, the outward normal to 8^}{xq), and Therefore, 
we finally arrive at 







271" i^^. 

Hl{0),xo) ^{9,r{9,xo))x—{9,r{9,xo)) g^{9,xo)d9 
0(7(0), xo) ^{9,xo) n\j{9,xo))?^i9,xo)d9 







89 



dx 



<^(7,xo)n*(7)|^^i7- (23) 



Given the hypothesis of Proposition 11.61 both terms in ()22() and ((221) have a continuous dependence 
on xq S (a, b), which concludes the proof. □ 



Appendix B. Upper bound on the area of the intersection between two balls 

Lemma B.l. For R G R+, let p, p' G satisfy \\p-p'\\ < R. Then the area A of Bji{p') D B'^{p) 
satisfies A < ^^^R\\p-p'\\. 
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Proof. The area A equals tt — h, where L is the area of the non-trivial lune Bji{p) n Bji{p') (see 
Figure ini). Let O, O' be the two points in the intersection dBpi{p) n dBfi{p'). Note that the triangle 




Figure 9. Areas of interest: A is the area of Bji{p')nBfj{p), T is the area of the 
triangle T{p, O, ^-j^), and CS is the area of the circular sector inside Bji{p) determined 
by ip,0,0'). 

with vertices O, p and p' , T{0,p,p'), and the triangle T{0' ,p,p') are isosceles. This implies that 
the diagonals of the polygon P{p, 0,p', O') intersect at the middle point Let ? be the angle of 

T{0,p,p') at p and D = fa^. Then, the area of the lune L can be computed as L = 2(CS — 2T), 
where CS is the area of a circular sector with angle 2c^ and T is the area of the triangle T{p, O, ^^-^). 
Since CS = ^i?^ ^nd T = ^D^R'^-D'^, we have that A = R'^{7r - 2?) + IDy/R"^ - D"^. Now, using 
that < D < R, we deduce that 

A < R^i-K -2<;) + 2RD . 

In order to finally bound the first term of the right-hand side of the inequality with a quantity 
proportional to Z), we use that <; = arccos(^). Consider now the function g{x) = vr — 2 arccos x — Kx. 
It is easy to see that for K > one has g'{x) < and g{x) < when < x < ^. In particular 

this implies that, for < ^ < ^, we have that vr — 2arccos(^) < K^. In other words, the former 
inequality is valid for ||p — < i?. This concludes the proof. □ 

Appendix C. Discrete- time LaSalle Invariance Principle 

The following result is an extension of two classical results: on the one hand, it extends the discrete- 
time version of LaSalle Invariance Principle [29] to algorithms defined via set-valued maps. On the 
other hand, it considers a more general notion of Lyapunov function (cf. Section [3.2(1 than in the usual 
statement of the Global Convergence Theorem [25] . 

Theorem C.l (Discrete-time LaSalle Invariance Principle). Let T be a closed algorithm onW C 
and let U be a Lyapunov function for T on W . LetxQ E W and assume the sequence {xn | n G N U {0}} 
defined via Xn+i G T{xn) is in W and bounded. Then there exists c G M such that 



Xn — > M n U^^{c) , 
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where M is the largest weakly positively invariant set contained in 

{xGR'^ \3y£ T{x) such that U{y) = U{x)]r\W. 

Proof. Let ^{x^) C W denote the w-limit set of the sequence {xn \ n £ NU{0}}. First, let us 
prove that 0,(xn) is weakly positively invariant. Let x G ^}{xn)- Then there exists a subsequence 
{xn^ri \ m £ NU {0}} of {xn I n G N U {0}} such that x„„ x. Consider the sequence {xn^+i I "t- S 
N U {0}}. Since this sequence is bounded, it has a convergent subsequence. For ease of notation, we 
use the same notation to refer to it, i.e., there exits y such that Xn^+i — > y- By definition, y G Q,{xn)- 
Moreover, using the fact that T is closed, we deduce that y G T{x). Therefore ^[xn) is weakly 
positively invariant. 

Now, consider the sequence {U{xn) | n G NU {0}}. Since {xn | n G N U {0}} is bounded and U is 
a Lyapunov function for T on W , this sequence is decreasing and bounded from below, and therefore 
convergent. Let c G M such that U{xn) — > c. Let us see that the value of U on ^{xn) is constant and 
equal to c. Take any x G Q{xn)- Accordingly, there exists a subsequence | m G NU {0}} such 

that Xnm X. Since U is continuous, U{xn^) — > U{x). From U{xn) — c, we conclude that U{x) = c. 

Finally, the fact that is weakly positively invariant and U is constant on Q{xn), implies that 

n{xn) C {x G I 3y G T{x) such that U{y) = U{x)} . 

Therefore, we conclude that x„ ^ Mn C/~^(c), where M is the largest weakly positively invariant set 
contained in {x \3y £ T{x) such that U{y) = U{x)] r\W. □ 



